Application No. 10/543,071 
AMENDMENTS TO THE DRAWINGS 
Figures 3a and 6 have been amended to replace French language labels with 
English language translations. No new matter has been added. 
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REMARKS 



Claims 1-9 are pending. By this Amendment, claims 1-9 are amended and 
new claim 10 is added. 

The present application has been translated from the original French. The 
specification, abstract, and claims have been amended herein to more closely conform to 
customary U.S. practice. In the drawings, Figures 3a and 6 have been amended to replace 
French language labels with English language translations. No new matter has been added 
and no narrowing amendments are intended. 



In view of the foregoing, it is submitted that this application is in condition for 



allowance. Favorable consideration and prompt allowance of the application are respectfully 
requested. 

The Examiner is invited to telephone the undersigned if the Examiner believes 
it would be useful to advance prosecution. 

Respectfully submitted, 



Customer No. 24113 \ 

Patterson, Thuente, Skaar & Christensen, P. 

4800 IDS Center 

80 South 8th Street 

Minneapolis, Minnesota 55402-2100 

Telephone: (612)349-5741 




James H. Patterson 
Registration No. 30,673 
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MARKED-UP COPY 
DEVICE FOR PRINTING AN IMAGE ON A LARGE SURFACE 

Field of the Invention 
This invention relates to a device for printing on a large surface. The field of 
the invention is that of the building and of the interior or exterior decorating trades. An 
object of the invention comprises the transfer of a large dimensions image onto a surface also 
of large dimensions. Another object of the invention comprises limiting the means that must 
be used to perform this transfer. Another object of the invention comprises allowing this 
transfer to be performed by a single operator. Another object of the invention comprises 
allowing the retouch / repair of a large dimensions image transferred on a surface also of 
large dimensions. 

Background of the Invention 
In the state of the art, different methods are known to transfer an image on a 

wall. 

A first method involves employing a painter to paint the wall from an original 
pattern. This method is as time consuming and costly as the complexity of the image to be 
painted. In fact, if the image comprises many features, the painter must use brushes of sizes 
compatible with these features. It thus takes an extremely long time to cover a wall with paint 
with a fine brush. 

A second method involves the industrial printing of the image on paper, 
followed by [[its]] cutting the paper in strips. This way wallpaper is obtained that must later 
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be stuck on the wall. This method has the usual drawbacks arising from the laying of 
wallpaper, i.e. the difficulties of the matching of the different wallpaper strips. Another 
drawback is related to the dimension[[s]] differences between the walls. It is assumed that 
remains unknown the length of the wallpaper strips and the way that must be used to print 
and cut them remains unknown . In addition with this method, the texture of the material on 
which the wallpaper is affixed stuek is lost, meaning that the aspect of the image is altered 
and the desired visual impression is not obtained. 

A third state of the art method involves using a very big plotter positioned in 
front of the wall on which the image is to be transferred. This device is very cumbersome and 
heavy. It is so bulky that its access into and thus its positioning in a room is sometimes 
impossible. Its operation by a single user is further impossible. 

Summary of the Invention 
According to the invention, some difficulties are solved by incorporating 
position determining, direction determining and printing means in a device operable with one 
hand. This device may take, for example, the external form of a paint roller in which the 
printing device has been substituted to the roller. The printing device comprises two wheels 
allowing the device to be moved on the surface while keeping a constant distance between 
the printing device and this surface. The device also comprises a position and direction 
determining device that allows a precise determination of its position on the surface on which 
an image is to be transferred. The knowledge of this position allows the reading by the device 
of a file defining an image to be transferred on the wall, the position on the wall being 
matched with a position in the image file. This file allows the determination of the printing 
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requests to be sent to the printing heads of the device, according to its position. This file 
defines an image whose dimensions are matched with those of the wall. The position 
determination is made, for example, by the projection of a grill / grid on the wall. This grill is 
detected by an optical sensor of the device. At each crossing of the grill, a position data is 

5 attributed. The reading of this data allows the device to localize itself. The direction is 
obtained by using a second sensor giving a second position, by the use of a gyroscope, by the 
detection of the grill slope or by a move sensor of the optical mouse type that allows the 
moves of the device on the wall to be measured. 

An operator thus performs the transfer of an image on a wall by moving the 

10 device according to the invention across the whole wall. According to an alternative 
embodiment, the device also comprises a memory allowing the parts of the wall already 
painted to be determined. Thus is avoid e d an accumulation of dye at some places is avoided. 
Thu s is al s o avoid e d t The need for the operator to be careful to evenly move the device on 
the surface is also avoided . 

15 The invention accordingly relates to a device for printing an image on a large 

surface, the device comprising[[:]] 

[[-]] means for a dye transfer on said large surface, and 

[[-]] at least one handling mean allowing an operator to handle the device to 
reproduce the image on the large surface, 
20 charact e riz e d by the fact that th e d e vic e compri se s: 

[[-]] means to determine the device position on the large surface plane, and 
[[-]] means to determine the device direction on the large surface plane, wherein 
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th e d e vic e also b e ing charact e riz e d by th e fact that the direction determining means and the 
position determining means cooperate with the dye transferring means to match the dye 
transfer with the device position and direction on said large surface. 

5 Brief Description of the Drawings 

The invention will be better understood while reading the following 
description in conjunction with the attached drawings. These are shown so as to be 
illustrative only and not limitative of the invention. Among th e s e In the drawings: 

10 [[f]]Eigure 1 generally shows a device according to the invention in a state of 

image transferring[[;]]. 

[[f|]Figure 2 shows a localizing grill according to the invention ^;!!. 
[[f]]Figures 3a and 3b show a device according to the invention and 
components that it the device comprises[[;]]. 
15 [[f]]Figures 4a, 4b and 4c show embodiments of the localizing optical 

sensor[[;]] according to the invention. 

[[fflFigures 5a and 5b show an acoustical localizing[[;]] according to the 

invention. 

[[fflFigure 6 shows several steps of a the method of using us e d par the device 
20 according to the invention in order to transfer an image on a large surface. 
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Detailed Description of the Invention 
In all the drawings, the same references indicate the same components. 
Figure 1 shows a device 101 according to the invention, positioned near a wall 
102 on which an image is to be transferred. The device 101 may be manually held and 
5 moved, like a for example a a paint roller. Figure 1 does not show the operator that uses handl e 
the device 101, for the sake of clarity of illustration. Figure 1 also shows a projector 103 
positioned in front of the wall 102. The projector 103 is thus comprised in an alternative 
embodiment of the invention allowing the device 101 to localize itself on the wall 102. To 
this end, the projector 103 projects on the wall a grid or grill allowing the wall 102 to be 
1 0 attributed a coordinate system that may be read by the device 101. 

Figure 2 shows an exemplary grill projected by the projector 103. This grill is 
a grid comprising^ for example^ horizontal and vertical lines. The direction of the lines need 
must not be horizontal or vertical; these lines may be inclined and define a non-orthogonal 
lines network. Figure 2 also shows that at each crossing of two lines a coordinate data is 
15 allocated. This data is A for example^ a barcode or an abscissa / ordinate couple. This data is 
read by the device 101 , this way to obtain a position determination on the wall 102 is 
obtain e d . The grill lines are typically very thin, less than 0.1" in width, and are spaced on the 
wall at distances from 2 inches to a few tens of inches. The coordinate data of a crossing are 
always placed at the position relative to the crossing. This allows a crossing and its 
20 coordinates data to be associated. 

Figure 3a shows a bottom view of a device 101 according to the invention. 
The device of [[f]]Figure 3a is the same as than the device illustrated in [[f]]Figure 1; other 
alternative embodiments of the device 101 will be devised below. The device 101 has the 
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shape of a painter roller. The device 101 comprises a handle 301 that allows to grasping and 
handling of the device 101. The device 101 also comprises a body 302 that is fixed to the 
handle 301 and extends in a direction perpendicular to the handle 301. The top of the device 
101 is supposed to be the part viewed by an operator when the device 101 is placed against 
the wall 102 in operation. The bottom is the part of the device 101 that is then facing the wall 
102. 

On its upper side, the body 302 comprises an optical sensor 303 that reads 
allows reading the data projected by the projector 103. Figure 3a also shows that the body 
302 comprises a microprocessor 304, a direction sensor 305, an image memory 306, printing 
means 307, means 308 to communicate with an external device i and a program memory 309. 
The components 303-309 are connected via a bus 310. When a function is requested of the 
device 101, this function is executed by the microprocessor 304 controlled by instruction 
codes from the memory 309. 

The memory 309 comprises several areas, each of these areas corresponding to 
instruction codes allowing the execution of a function by the device 101. The memory 309 
comprises an area 309a corresponding to the position determination of the device 101. An 
area 309b contains instruction codes to retrieve image data written in memory 306. An area 
309c contains instruction codes to control the printing means 307. 

Figure 3b shows a bottom view of the device 101 . At each end[[s]] of the body 
302, the device 101 has a wheel. The wheels 311 and 312 are fixed on axles extending in a 
direction perpendicular to the wall 102 plane and perpendicular to the handle 301. The 
wheels 311 and 312 each comprise a pressure sensor connected to bus 310. These pressure 
sensors act like switches for the operation of the printing means 307. The printing means are A 
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for example^ an ink jet device. This device thus comprises [[4]]four nozzle lines, [[3]]three 
color lines and [[l]]one black line. These four lines are parallel and near each other. At least 
one nozzle of each line is needed to print a dot in any visible color. The whole of these four 
lines form an ink jet printing head. This printing head may be considered ttke a series of 
points. The nozzles must project ink only when at an adequate distance from the surface to be 
colored. This distance is sensed for example through the wheels 311 and 312. When the latter 
are in contact with this surface, this surface applv applies a pressure on the wheels and this 
pressure is detected by the device 101 that thus knows that it may activate the nozzles. In an 
alternative embodiment, this activation is done by the operator that operates a button of a user 
/ device interface 313 connected to bus 310, 

In an alternative embodiment, the body 302 comprises a third wheel 317 
whose rotational axis is parallel to the rotational axis of the wheels 311 and 312, but not 
collinear with this axis. In other words, the wheel 317 is not in alignment with the wheels 31 1 
and 312. The third wheel 317 also incorporates a pressure sensor. Using three wheels allows 
to define a plane and to maintain a precise distance between the wall 102 and the printing 
means 307. The third wheel is offset in the direction of the handle 301 relatively to the axis of 
wheels 311 and 312 axis. Preferably, the printing means 307 are offset relatively to the 
wheels 31 1 and 312 axis, this offset being in a direction opposed to the direction in which the 
handle 301 is placed. This relative positioning of the printing means 307 allows limiting the 
unprintable margins. 

The nozzle[[s]] distribution on four lines is but an example. In practice, this 
distribution depends on the printing head used. Particularly, the color distribution will vary 
change from one[[a]] manufacturer to another. Multicolor printing heads, on which the color 
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distribution, i.e. the nozz!e[[s]] distribution, is particular or single color printing heads 
distributed in lines or in squares may be used. 

The sensor 303 is a CCD sensor or charge coupled device, responsive to light, 
receiving the image projected by the projector 103. This CCD sensor has a resolution of at 
least 0.01 inch and, preferably, such a definition that it always has in its field of view at least 
one crossing of the grid projected by the projector 103. In practice, the sensor definition 
allows te obtaffl obtainment of a square image of dimensions slightly larger than the grid 
pitch. The CCD sensor may be located directly on the path of the light rays transmitted by the 
projector 103, eventually through a lens. The light rays may also be deflected to the CCD 
sensor via a mirror or a prism. Figure 4a shows a device 101 whose wheels 311 and 312 are 
in contact with the surface 102. Figure 4a illustrates the fact that that a mirror 401 receives 
the light rays transmitted by the projector 103 and reflects them to a CCD sensor. Figure 4b 
shows an alternative embodiment in which the light rays pass through a semi-reflective 
mirror 402, are reflected by a mirror 403 and then reflected by the mirror 402 to the CCD 
sensor. Again, the grid is superimposed, by optical projection, on the surface to be painted. In 
an alternative embodiment, the sensor 303 receives the grid projection on a screen. This 
alternative embodiment is thus, for example, the embodiment of figure 4b in which a screen, 
preferably white, is substituted to the vertical mirror 403. According to another embodiment, 
the sensor 303 is positioned directly in front of the projector 103. 

The sensor 303 is thus able to perform a localizing image acquisition, this 
image containing a grid part and a localizing data attributed to a crossing of this grid part. By 
this localizing image, the device 101 is able to localize on the surface 102. In an alternative 
embodiment, the sensor 303 does not always have a crossing in its field of acquisition. 
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According to this embodiment, between two readings made on crossings, the sensor measures 
the relative displacement of the background grid with the help of the grid features that it 
perceives. To this end, flaws may be added to the grid, allowing measuring the relative 
displacement of said grid. This relative displacement of the grid relatively]] to the sensor 
303, thus to the device 101, may also be estimated by a sensor detecting the wall 102 and its 
flaws. 

The device direction determining means 305, relatively]] to the wall, are 
embodied by an optical or mechanical gyroscope. An optical gyroscope is obtained,, for 
example,, by analyzing the image acquired by the sensor 303 and by determining the angle 
formed between a grid line and an edge of this image acquired by the sensor 303. An optical 
gyroscope may also be acquired by providing the device 101 with a second sensor 314 
identical to the sensor 303. The device 101 is thus able to define the line joining these two 
sensors at the localizing image acquisition instant date and consequently to direct itself at this 
instant. A mechanical gyroscope is embodied by any device producing a signal allowing 
estimating a deflection relative to the vertical direction. 

Connector 308 allows connecting the device 101 to other apparatuses. The 
connector 308 may be A for example^ an USB port, a Fire Wire port, a Blue Tooth connector or 
any other connector type, either of the wired or wireless type. 

Figure 6 shows an operation step[[s]] series of the device 101 according to the 
invention. Figure 6 shows a step 601 preceding the loading of an image and the projection of 
the grid. The grid projection is performed first by correctly positioning the projector 103 
relatively to the wall 102. This positioning is performed, if needed, with the help of 
micrometer screws. The positioning is correct when the projected grid covers the surface to 
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be painted. The loading of the image in memory 306 is performed via connector 308. The 
image depicts the picture to be transferred on the wall 102, The dimensions of the image to be 
transferred are matched with the wall 102 dimensions and the printing resolution. The 
printing resolution is expressed, for example, in dots per inch (DPI). This resolution is a 
function of the printing heads 307. The dimension in pixels of the image stored in memory 
306 is thus obtained by multiplying the wall dimensions by the printing resolution. Either 
memory 306 contains the whole image, or the device 101 is continually connected to a third 
device storing the image, the device 101 having access at will to this third device via 
connector 308. A third device may be A for example^ an external hard disk or a laptop 
computer. 

From step 601, the control goes to step 602 to determine the device 101 
position. This position is determined by the device 101 interpretation of the image acquired 
by the sensor 303. As soon as the image to be transferred is loaded, an operator may hold the 
device 101 in place against the wall 102 and begin the image transfer or image printing. 

From step 602, the control goes to step 603 to determine the device 101 
direction. This direction determination is obtained by the interpretation of the signals 
produced by the means 305. 

From step 603, the control goes to step 604 to determine the printing controls, 
i.e. to determine the controls to be sent to printing means 307. In an alternative embodiment, 
the apparatus stores in a memory 315, while the printing proceeds, an image rendering the 
printing progression state. The content of memory 315 relates to what has already been 
printed. At step 604, the device 101 knows its coordinates and its direction. The device uses 
this knowledge to read out of memory 306 the color data to be used to control the printing 
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means 307. The memory 306 image is se formed such that it may be superimposed on the 
surface to be printed. The knowledge of the coordinates on the surface to be printed thus 
corresponds to the knowledge of the coordinates on the image stored in memory 306. To 
most efficiently determine the printing controls, the device 101 must also be able to recall the 
already printed pixels. Thus, each time the device 101 prints a pixel, it updates the memory 
315 content. This update involves transferring the image to be printed into memory 315, 
while this image is being printed on the wall 102. 

At step 604, as soon as the device 101 has read the memory 306 content 
corresponding to its position, the device reads the memory 315 content corresponding to its 
position and then the device compares the two readings results. The result of a reading, 
assuming the device has a linear printing head, is the description of a pixel line, i.e. the 
description of a color for each pixel. When a pixel is marked in memory 315 as already 
printed, it does not have to be printed again. The description of this pixel then becomes 
transparent. The device 101 thus executes a substraction between the first reading result and 
the second reading result. The subtraction result is a line description in which the already 
printed pixels are attributed a transparent color. The result of this subtraction is the printing 
control. Step 604 involves a data reading out of memory 306. 

From step 604, the control goes to a printing step 605 in which the device 101 
uses the printing control determined at step 609 in order to control the printing means 307. At 
each pixel corresponds a definite number of nozzles. These nozzles are activated according to 
the color to be produced. For a transparent pixel, no ink is projected. At step 605, the device 
101 also updates the memory 315 contents. 
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Steps 602 to 605 are repeated in cycles, either at a constant frequency or each 
time the device 101 detects a move. This detection is accomplished either through the wheels 
moves or via a sensor 316 connected to bus 310 and mounted at the bottom of the device 101 
in front of the wall 102 or directly by the sensor 303. The sensor 316 is consequently of the 
type that equips an optical mouse and is able to provide a direction and a move distance. 

The repeating of steps 602 to steps 605 allows to transfer of the image from 
memory 306 to the wall 102, by way of a printing being done while the device 101 moves 
across the whole wall 102 surface. 

The dye transfer means 307 are provided in this alternative embodiment by an 
ink jet printing head comprising nozzles in alignment along at least 4 lines. In other 
alternative embodiments, these means may be provided by printing heads projecting paint or 
another chemical matter able to alter the appearance of the surface on which the image stored 
in memory 306 is to be transferred. 

According to an alternative embodiment, a panel on which a grill like the grill 
described in figure 2 is substituted for te the projector 103. Figure 4c shows such a panel 404 
positioned parallel to the wall 102. The panel is thus perceived by the sensor 303. In this case, 
the sensor 303 is localized on the panel. The panel 404 is placed at a distance from the wall 
102 such that there is enough room for an operator to handle the device 101 between the 
panel and the wall. The device 101 position and direction determinations are then 
accomplished relatively]] to the panel. 

According to an alternative embodiment of the invention, the projector 103 
projects the image to be transferred on the wall 102. In this case, the device 101 comprises a 
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sensor that allows perceiving this projected image and the result of this perception actually 
allows determining the colors to be printed according to the device 101 position. 

According to an alternative embodiment, the position determination is 
obtained by printing marks invisible to the naked eye. The device thus comprises a scanner 
that allows p e rc e iving perceives these marks around the printing zone. These marks are 
applied by the device 101 while the printing proceeds, using ink invisible except to the 
scanner. When needed this scanner may illuminate the zone with an adequate light. The 
device 101 may thus superimpose marks invisible to the naked eye to the image that it is 
printing. By a step-by-step scanning, the apparatus knows all the time its position by mean of 
the marks printed at a preceding and adjacent pass. At the beginning of this operation, the 
marking is initiated by a printed sheet glued on the wall. This sheet bears marks invisible 
except to the scanner. The position of this sheet in the image to be printed is known. The 
printing may thus begin on this sheet and from there on the rest of the wall. At the end of the 
operation, the sheet is removed and the device 101 is moved across the surface left in order to 
paint this area. 

According to an alternative embodiment, the position and direction 
determinations are accomplished by ultrasonic means. Thus, providing [[3]] three transmitters 
(501-503) at definite positions in the room and two receivers on the device 101 is only 
needed. The device 101 is then able to determine its distance from the [[3]] three transmitters 
and consequently, by triangulation, to determine its position. According to this embodiment, 
only one transmitter may also be used by providing the device 101 with [[3]] three receivers 
(504-506). According to this embodiment, means to store the transmitter(s) position in 
memory are needed in order to be able to place them anew at the same place(s) to execute 
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maintenance of the picture. This storage in memory may be accomplished with a nail set at a 
precise place, for example. These embodiments assume that the device 101 knows the 
ultrasound transmitting instant dates. These dates are communicated via means 308, for 
example. 

According to an alternative embodiment of the invention, the position 
determination is accomplished by mean of a laser scanning the wall surface. This laser is 
detected at a t instant by the device 101. This t instant is matched to a known laser position. 
This position is obtained by sending a request to the laser-transmitting device, via means 308, 
for example. The laser may also draw on the wall 102 a grid like the grid shown [[fflFigure 2. 

According to an alternative, the direction is determined by mean of sensor 316 
that is able to measure a move relatively to a known position. From a known initial position, 
the already realized move and consequently the current position and direction may thus be 
estimated. 

With the device according to the invention, several layers of paint may be 
applied. To this end, only clearing of the memory 315 contents is mfy needed, and the 
printing operation is resumed as if it actually never began before. 

With the device according to the invention, te repaint ing / repairing a definite 
zone of the wall is also possible. To this end, the device 101 must be repositioned on the 
image transferred on the wall 102. This repositioning is done via physical marks, like the wall 
corners that allow repositioning the grill projected by projector 103. The correct grill 
repositioning is thus enough to reposition the device 101. The repositioning may also be 
accomplished by shape recognition on high contrast zones. In that case, the device 101 
comprises a scanner that reads a zone of the printed image. Then, the device looks in the 
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memory 306 image for the zone corresponding to the scanned zone. Once the zone found, the 
repositioning is executed. When the device 101 comprises a scanner, the latter may be used to 
acquire an image. This acquisition is realized by moving the device 101 above the image 
whose acquisition is desired. This acquired image is then stored, for example, in memory 
306. This acquired image may later be transferred on another wall or to a third device via 
means 308. 

While the painting proceeds, the projector 103 may accidentally be knocked 
and moved. In this case, the projector must be repositioned. To this end, the projector 103 
may comprise a collision sensor that allows warning the operator when a grid repositioning 
must be accomplished. In that case, the repositioning is the same as the above described 
repositioning. 

The operator / apparatus interface 313 is located either on the operator body or 
on the handle. The interface comprises, for example, on / off buttons, a memory 315 reset 
button, a button and to override the printing regardless of memory 315 contents. This 
interface also comprises light diodes and / or acoustic means that allow to warn the operator 
of definite events like a device mevemoving too fast on the wall, a low ink supply level, or a 
grill move. The speed of the moving device 101 is easily estimated through wheels 311, 312 
and 317 rotational speed, sensor 316, or sensor 303. These wheels and sensors give also give 
access to thea device 101 acceleration. Thus, when these events are detected, the printing 
may also be interrupted in order to avoid flaws in the image transfer if means 307ar e 307 are 
not able to accomplish the printing in a manner compatible with the speed of the moving 
device 101. The printing is also interrupted if the operator is placed between sensor 303 and 
the grid. 
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The dye tanks containing inks, paints or other fluids, are either incorporated ]n 
to the device 101 or remotely provided elsewhere. The dye supply is then realized through 
pipes joining the tanks to the device according to the invention. 

The data computing and reading may also be remotely executed, like 
memories 306 and 315, on a third apparatus connected to the device 101. 

An image transfer on a vertical wall has been described, but the teachings of 
the invention may also be applied whatever the surface and its direction are. 

In practice, the wall may not have a perfect rectangular shape. In this case, 
either the image is cut in order to take the actual shape into account or the device 101 is 
consequently configured. This configuring is realized, for example, by positioning the device 
101 at the angles of the zone on which the image is to be transferred. At each angle 
positioning, the operator pushes a button, thus allowing the device 101 to define the printing 
zone. This zone is located in the polygon defined by these angles and the printing is activated 
only when the device 101 position is determined to be inside this polygon. 

In an alternative embodiment, the device according to the invention is 
operated by a robot that moves the device across the wall. 
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DEVICE FOR PRINTING AN IMAGE ON A LARGE SURFACE 

Abstract 

This d e vic e may b e hold A device for printing an image on a large surface and 
that may be held and moved manually and is able to determine its position and direction on a 
surface. The device uses this knowledge to determine which colors are to be applied on 
the surface. This determination is accomplished by matching the determined coordinates and 
an image stored in a memory of the apparatus device . The stored image may then be 
superimposed to the surface to be painted. 

Figur e 3a. 
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DRAWINGS 

Figur e 3a: 



309a Localizing 

309b Imag e data r e trieval 

309e Printing control 

Figure 6: 

604 Imago loading + grid projecting 

603 D e vic e position d e t e rmining 

603 Device direction determining 

604 Printing control det e rmining 

605 Printing 
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